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M ' Abstract. We study a one-dimensional random walk with memory in which the step 

lengths to the left and to the right evolve at each step in order to reduce the wandering 
2 ' of the walker. The feedback is quite efficient and lead to a non-diffusive walk. The time 

^ ■ evolution of the displacement is given by an equivalent Markovian dynamical process. 

The probability density for the position of the walker is the same at any time as for 

a random walk with shrinking steps, although the two-time correlation functions are 

quite different. 

o 
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en ' 1. Introduction 

vn 

^ , Introducing long-range correlations into a random walk may lead to drastic changes 

in its asymptotic behaviour. Depending on some parameter governing the strength 
and sign of the correlations, the Hurst exponent a of the mean-square displacement, 

^ , given by t^° at time t, can be modified. The dynamics can evolve from diffusive 

(a = 1/2) to subdiffusive (a < 1/2), superdiffusive or persistent (a > 1/2). Such 
random walks with long-range memory have been extensiveley studied in the last years 

[H El El SI El El [318119]. 

In this work we consider a one-dimensional random walk in which the walker tries 
to controU his wandering. In order to do so, at time t the walker reduces the step 
length in the direction of the previous step at time t — 1 while the sum of the step 
lengths in the two directions remains constant. For example, after a step to the right 
the length of a step to the right is reduced and the length of a step to the left is increased 
accordingly. The step lengths evolve in time in a non-systematic way and their actual 

I Laboratoire associe au CNRS UMR 7198. 
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values depend on the whole history. Thus the walk has a memory and belongs to the 
class of non-Markovian stochastic processes [TO] . 

We show that such a controlling process is quite efficient since the mean-square 
displacement saturates at long time, leading to a walk which is non-diffusive (a = 0). 
We prove its equivalence to a well studied Markovian dynamical process [H]. The 
probability density for the position of the walker at time t is found to be the same as 
for the random walk with shrinking steps |T2l [131 EH [HI [Ml |T7] although the two-time 
correlation functions for the position of the walker are quite different in the two walks. 
The singularities of the associated probability density have been much studied since the 
1930s in the mathematics literature where the problem is known under the name of 
Bernoulli convolutions [I8l|19l[20l[2ll[22l[23l[2ll25]. 

The random walk with variable step lengths has found some physical applications. 
For example it has be used to expain some aspects of the motion of a Brownian particle in 
a shear flow |26] as well as the spectral line broadening for single-molecule spectroscopy 
in a disordered solid |271 [28] . 

The outline of the paper is the following: The details of the model are presented in 
section 2. The moment-generating function of the walk, which is actually given by the 
canonical partition function of a non-interacting Ising model, is obtained in section 3. 
In section 4 we show that the random walk with memory has the same time evolution 
as a Markovian dynamical process and that it has the same probability density as 
the random walk with systematically shrinking steps. We also compare the two-time 
correlation functions. We end with the conclusion in section 5. 

2. Model 

The walker performs a discrete time one- dimensional random walk starting at the origin 
Xq = at t = 0. One associates an Ising variable ctj = +1 (—1) with the ith step to the 
right (left). The Ising variables ctj {i = l,t), taking on the values cxj = ±1 with equal 
probability, give a complete description of the walk. The step lengths at time t, If for 
a right step and d^ for a left step, satisfy the constraint 

£+ + £,- = 2, (2.1) 

and evolve according to the following rules for t > 1 

^t-l = +1 > \ „- n \ n+ ' ^*-l = ~1 ^ \ n+ o \ n- ' l^'^) 



't 



ACi it = 2-Xi^_ 



with if = i^ = 1 and < A < 1. The limit A = 1 corresponds to constant step lengths, 
i.e., to the Bernoulli random walk. When A < 1 the reduction of the step length in 
the direction of the previous step and its concomitant increase in the opposite direction 
reduce the wandering. When A = the walker is restricted to stay for some random 
waiting time either atX = +lorX = — 1. 
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Due to the constraint fl2.ip a single step length is really needed to describe the 
evolution. Let £j = £^, for t > 1 we have 

at-i = +l^lt = \^t-i. a(_i = -l^£i = 2(l-A) + A£i_i. (2.3) 
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Figure 1. Random walks with memory (thick blue line) and Bernoulli random walks 
(thin red line) generated with the same random nmxibers for A — 0.99 (a), 0.95 (b), 
0.9 (c). There is a strong reduction of the wandering for the walk with memory, even 
for values of A close to the Bernoulli value A = 1. 



(2.4) 



X = X 



t-i 



Xt 



Xn = 



Xt 



Making use of the Ising variables, equation (12. 3 p can be simply written as 

£t = A£t_i + (l-A)(l-a,_i), £i = l. 

Let Xt be the position of the walker at time t and Xt its increment. One has 

4 iiot = +l 

^ -{2 -(it) iiat = -l 

which translates into 

Xt= it + CFt-l, Xi = (Ji . 

It is easy to verify that equations (12. 4p and (12.60 lead to the mean values 

(£,) = !, (X,) = (a;,) = 0, 

as expected for a symmetric walk. In figure [1] random walks with memory are compared, 
for different values of A, to Bernouilli random walks generated with the same random 
numbers. The feedback is quite efficient in controlling the wandering, even for A close 
to 1, the Bernoulli limit. 



(2.5) 

(2.6) 
(2.7) 
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3. Moment-generating function 

The moment-generating function for tlie position of the walker at time t is given by 

Pa(^, t) = {eMzXt)) = ^ Tr{,} exp{zXt) (3.1) 

since the walks with t steps are equiprobable with probability 1/2*. The trace over the 
Ising variables gives the sum over all the possible histories. Thus the moment-generating 
function is given by the canonical partition function at inverse temperature z of an Ising 
model with Hamiltonian —Xt{{a}). 

In order to find out the expression of Xt we first calculate it by induction. At t = 2 
equation (12. 4p gives 

£2 = A + (l-A)(l-(Ti). (3.2) 

Let us assume that the step length it is given by 

t-i 

it = X'~' + {l-X)J2 ^*"'"'(1 - ^.) ' (3-3) 

i=i 
which agrees with (13. 2p for t = 2. Using (12. 4p . one obtains 

i-l t 

£i+i = A* + (l-A)^A*-^(l-a,) + (l-A)(l-at) = A* + (l-A)^A*--'(l-a,), (3.4) 

in agreement with (13. 3p . Thus (13. 3p . which remains true at t + 1, is true at any time 
t > 1. Since 

{l-X)J2 ^''''' = (1 - A) 5^ A^- = 1 - A*-^ , (3.5) 

i=i i=o 

equation (13. 3 p reduces to 

f-i 
£t = l-(l-A)5^A*--'-S-. (3.6) 

i=i 
The step length to the left, it , is related to the step length to the right, if = it, by 
i-({a}) = 2-it = iti{-a}). 
According to (12. 6 p 

t-i 
a;t = at-(l-A)J]A*-^-V,, (3.7) 

3=1 

and 

X, = ^ a, - (1 - A) ^ ^ y-^-\ = E ^^ - (1 - ^) E ^^- E ^''''' 

i=l i=2 j=l 1=1 j=l i=j+l 

= ^a,-(i-A)x:^, E A'= = E^^-E(i-^*">^ = ^* + E^*"''^^- 

j=i j=i fc=o i=i i=i i=i 

i 

= E ^'''^^ ■ (3-8) 
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One may notice the close connection between Xt and the deviation of it from its 
mean value, £4 — 1 = —(1 — A)Xt_i, which follows from fl3.6p and (13 .Sp . Thus 
the scaled and centered random variable {It — 1)/(1 ^ ^) has the same symmetric 
probability density as Xt-i. According to (12. ip and (12. 2p one has < £4 < 2 so that 
-1/(1 -\)<Xt< 1/(1 - A) as expected. 
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Figure 2. Moments of the asymptotic position of the walker X = Xt^oo as a function 
of the control parameter A. 



The position of the walker at time t is associated with a non-interacting Ising 
Hamiltonian. The moment-generating (or partition) function follows from equations 
(13. ip and (13. 8p and reads 



Px{z,t) = — Tr{<,}exp 



t t-i 

JJcosh {zX'~^) = JJcosh [zX^] 

j=l j=0 



z I Y^ A*-V, 
0=1 
The moments of the position of the walker at time t are given by: 



(^D 



dz^ 



(3.9) 



(3.10) 



z=0 



Since the walk is symmetric P\{z,t) is an even function of z and odd moments vanish. 
To calculate even moments, one expands cosh(2;A-') in (13.90 and collects terms with the 
same power of z in the product: 



t-i 



^A(^,t)=n 

i=o 






fc=0 



(2A;)! 



t-i 



1 Y-^'' 2 



j=0 



t-1 






Li=o 



0<j<fe<t- 



,(2! 



z^ + ---(3.11) 



Applying (I3.10p one obtains: 



t-i 



(X,^) = Y: A^^- = ^ , (X/) = E ^'^' + 6 5^ ^'^■^'' = 3 {X^r - 2 ^ 



1-A 



4t 



i=o 



i=o 



o<j<fc<t-i 



A4 



.(3.12) 
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Figure [2] shows the evolution with A of the values of (X^) and (X"^) where X = Xt-^^o 
is the asymptotic position of the walker. The mean-square displacement remains quite 
close to 1 for values of A up to 0.7-0.8. 

4. Relation to Markovian processes 

The random variable X^ can be generated by a Markovian dynamical process which 
follows from (13. 8p : 

t+i t 

Xt+i = Y, A*"^'+V, = a^+i + \J2 ^'''^'j = ^Xt + at+i . (4.1) 

Such random iteration processes have been extensively studied in the mathematics 
litterature (see |11] for a review). Equation (14. ip leads to a recursion relation for the 
moments 

(^2i) = E (?) ^'^(^r) (-Si") = E (2I) ^''<^'') (4.2) 

n=0 ^ ^ A:=0 ^ ^ 

since X^ and o"i+i are independant random variables and {cr^^^) = 1 when n is even 
and otherwise vanishes. When t — )■ 00 one obtains 

A:=0 ^ ^ 

The non-Markovian random walk with memory is also related to a Markovian one- 
dimensional random walk with shrinking steps [13]. In this model the position of the 
walker at time t is given by 

t t 

^t = 5^^,a,=5^A^-V,, (4.4) 

j=i i=i 

where aj takes on the values ±1 with equal probability. There is now a systematic 
reduction of the step length which takes the same value for both directions. The moment- 
generating function is given by: 

t t-i 

= Yl cosh {zX^-^) = Yl cosh {zX^) . (4.5) 

Thus the non-Markovian random walk with memory has the same probability density 
function as the Markovian random walk with shrinking steps. 

The evolution of the asymptotic behaviour of the probability density as A is varied 
is illustrated in figure El It evolves from a Cantor set behaviour of the support for 
small values of A, through a uniform density for A = 1/2, to a Gaussian density when 
A — )■ 1. The extremes are easily explained by looking at equation (14. ip . When A — )■ 0, 
Xt — )■ o"f and one obtains the singular Bernoulli density with two delta peaks at ±1. 



Pxiz,t) = — Trj^jcxp 
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Figure 3. Simulation results for the probability density P\{X) for A — 0.4 (a), 0.5 
(b), 0.55 (c), 1/0 = (75- l)/2 = 0.618... (d), 0.65 (e), 0.9 (f). For each value of A 
the data are collected on 10^ samples of the walk, at time t = 50 to 100 for the largest 
values of A, with a spatial resolution of 10~^. 



When A — !■ 1, Xt — )■ X]j=i ^j ^^'^ ^^^ density is Gaussian. When A 
the characteristic function is given by 

k\ _ sin(2A;) 
2^/ ~ 2k 



Pi/2(ik,oo) = Y\cos 



j=0 



1/2 and t ^ oo, 



(4.6) 



which is the Fourier transform of the uniform density 

Pl/2(X) = 



1/4 




Xg[-2,2] 
otherwise 



(4.7) 



The probabihty density Px{X) is known to be either absolutely continuous or purely 
singular depending on the values of A [18j. For A < 1/2 its support is a Cantor set with 
zero Lebesgue measure so that Px{X) is singular. It has been shown by Solomyak [23] 
that the cumulative distribution is absolutely continuous for almost all A > 1/2. But 
Erdos [20] showed that Px{X) is singular in [1/2, 1] for an infinite set of A values such 
that 1/A is a Pisot number [29] like = (vS + l)/2, the golden ratio. 

Although the two walks share the same probability density, their time evolutions 
are quite different as shown in figure H] where the random walk with memory keeps 
on fluctuating at long time whereas the random walk with shrinking steps is quickly 
frozen. This difference can be put in evidence looking at the behaviour of the two- 
time correlation functions. Let us first consider the random walk with shrinking steps. 
Making use of the property of the two-spin correlation function, {aiO-j) = 6ij, equation 
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(113]) leads to 



t t+T 



i=l j = l 



1=1 



1-A 



2t 



(X^) , (4.8) 
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Figure 4. Random walks with memory (thick blue line) and random walks with 
shrinking steps (thin red line) generated with the same random numbers for A — 0.999 
(a), 0.995 (b) and 0.99 (c). Although these random walks share the same probability 
density, their two-time statistical properties are quite different. 



whereas one obtains 



t t + T 



t 



1-A 



2t 



^XtX.^r) = E E A"^^-^-^(^^^.) = A^ E ^'^"' = ^^ _ X2 



1-A2 



{x't)y 



(4.9) 



for the random with memory where the two-time correlation function decays 
exponentially with r. 



5. Conclusion 



In this work we have shown how the wandering of a random walker can be efficiently 
controlled by changing the step lengths at each step. Reducing them in the direction of 
the previous step while keeping their sum constant leads to a non-diffusive random walk. 
Surprisingly the probability density is the same as for a random walk with systematically 
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shrinking steps which shows quite different ffuctuations (see figure H]) as shown for the 
two-point correlation functions. 

Instead of controlling the wandering by changing the step lengths, one can modify 
the jump probabilities to the right and to the left, depending on the direction of the 
previous step. A preliminary study indicates that in this case the walk remains diffusive 

Eol. 
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A Pisot number is an algebraic number, i.e. the root of a polynomial with integer coefficients with 
the property that other roots are less than one in modulus. 

In this model the step lengths are constant and the jump probablity to the right pt (left qt — 1 — Pt) 
at time t is changed into pt+i = Xpt ( qt+i — ^Qt) at time i + 1 when the walker jumps to the 
right (left) at time t. Then the diffusion coefficient evolves from to 1/8 as A/(2-|-6A) when the 
controlling parameter A increases from to 1_. It is discontinuous at A = 1 where it jumps from 
1/8 to 1/2. We are currently looking for the exact expression of the moment-generating function 
which is the partition function of a one-dimensional Ising model with long-range interactions. 



